Original address: http://blog.chinaunix.net/uid-11065483-id-3654882.htmlBecause the company needs to monitor the line record of QQ, originally used the structure of the light +panabit+splunk to do record. Panabit use is quite comfortable, but when the day of the Splunk log records more than 500MB, Splunk free version can no longer use, which makes me very depressed. So I began to look for other solutions, and finally I found the Graylog2.
[Original] Graylog2 Installation notes under Centos 7.3, centosgraylog2
1. Open graylog2 official documentation, address: http://docs.graylog.org/en/2.0/pages/installation/docker.html#configuration2. find useful information from the document for installation. Here, the installation method is docker installation, including graylog2/server: 2.1.2-1, mongo: 3, elas
GRAYLOG2 is an open-source log storage System, written by the Java language Server, capable of receiving log information sent by TCP,UDP,AMQP protocol, and fast storage based on the MongoDB database server, through a ruby-based Web management interface , let's easily manage your logs.
1. Component Preparation
name
Component Name
Notes
1
Mongodb
2
Elasticsearch
suggests installing Symfony/browser-kit ()Symfony/http-kernel suggests installing Symfony/class-loader ()Symfony/http-kernel suggests installing symfony/config ()Symfony/http-kernel suggests installing symfony/dependency-injection ()Psy/psysh suggests installing Ext-pdo-sqlite (the doc command requires SQLite to work.)Paragonie/random_compat suggests installing Ext-libsodium (provides a modern crypto API that can is used to generate Rando M bytes.)Monolog/monolog suggests installing aws/aws-sdk
ptachoire/cssembed (Assetic provides the integration with phpcssembed to embed data uris) monolog/monolog suggests installing doctrine/couchdb (Allow sending log messages to a CouchDB server) monolog/monolog suggests installing ext-amqp (Allow sending log messages to an AMQP server (1.0+ required)) monolog/monolog suggests installing ext-mongo (Allow sending log messages to a MongoDB server) monolog/monolog suggests installing mlehner/gelf-php (Allow sending log messages to a
---Then we will find that a composer.bat batch file is created in the E:\composer directory---E:\composer>composer-vComposer version 1.0-dev (ea037305499d300f3a534b36a62abcdd1ba3479d) 2015-04-24 10:08:11---at this point we execute the above code will find a version number, then we installed successfully------Then we write a test case with the Monolog logging component---E:\composer>composer require "monolog/monolog:1.2.*"./composer.json has been createdLoading Composer repositories with the pack
installing leafo/scssphp-compass (Assetic provides the integration with the SCSS compass plugin) kriswallsmith/assetic suggests installing ptachoire/cssembed (Assetic provides the integration with phpcssembed to embed data uris) monolog/monolog suggests installing doctrine/couchdb (Allow sending log messages to a CouchDB server) monolog/monolog suggests installing ext-amqp (Allow sending log messages to an AMQP server (1.0+ required)) monolog/monolog suggests installing ext-mongo (Allow sending
leafo/scssphp (Assetic provides the integration with the scssphp SCSS compiler) kriswallsmith/assetic suggests installing leafo/scssphp-compass (Assetic provides the integration with the SCSS compass plugin) kriswallsmith/assetic suggests installing ptachoire/cssembed (Assetic provides the integration with phpcssembed to embed data uris) monolog/monolog suggests installing doctrine/couchdb (Allow sending log messages to a CouchDB server) monolog/monolog suggests installing ext-amqp (Allow sendi
(Allow sending log messagesTo a GrayLog2 server)Monolog/monolog suggests installing ext-amqp (Allow sending log messages to anMQP server (1.0 + required ))Monolog/monolog suggests installing ext-mongo (Allow sending log messages to a MOngoDB server)Writing lock fileGenerating autoload files
--- Execute the above code and we will find that some more files in the E: \ composer directory are as follows :---
The following is the test code:
Require 'ven
aggregation system
GRAYLOG2-Pluggable log and event Analysis server with alarm options
Heka-Stream processing system, which can be used for log aggregation
Kibana-Visualizing log and timestamp data
Logstash-Tools for managing events and logs
Octopussy-Log management solution (visualization/alarms/reporting)
MonitoringMonitoring software
CACTI-web-based network monitoring and graphics tools
Cabot-monitoring and alerting,
Graylog 's Log collection work is similar to Logslash and is a process that needs to be input-filter-output . Here are three of the most common log records to illustrate.??1,TCP message Log????Setup complete discovery takes effect immediately and does not require a restartTCP6 0 0:: 1:9300:::* LISTEN 1013/javaTCP6 0 0::: 33333:::* LISTEN 1010/java??test it on any Linux machine that installs NC :[[email protected] test]# echo ' Date ' | NC 192.168.1.135 33333[Email protected] test]#??Review the
-based Log System
MongoPress: an open-source CMS for MongoDB and PHP
Shooter branch project-MongoDB-based Open Source short URL Service
Short: an open-source short domain name project combining Node. js and MongoDB
MongoDB-based GridFS Image Storage
Graylog2: an open source syslog Storage System Using MongoDB
Using MongoDB to build an intelligent data stream filtering system
Use MongoDB to store web. py sessions
5. MongoDB client and tool set
Introduction
If you use elasticsearch to store your logs, this article provides you with some practices and suggestions.
If you want to collect logs from multiple hosts to elasticsearch, you have the following options:
Graylog2 is installed on a central machine. Then it inserts logs into elasticsearch, and you can use its beautiful search interface ~
Logstash has many features, including what logs you can input, how to transform and filter, and whe
collection system using FLUENTD + MongoDB
KARAIT: Message Queuing built with MongoDB Capped collection
Mongodb-log: MongoDB-based log system
Mongopress: A MongoDB plus PHP open-source CMS
Sagittarius Branch Project-open source short URL service based on MongoDB
Short:Node.js Open source short domain project with MongoDB
Image storage based on MongoDB Gridfs
GRAYLOG2: An open-source syslog storage System using MongoDB
C
GRAYLOG2: An open-source syslog storage System using MongoDB
Constructing intelligent data stream filtering system with MongoDB
Using MongoDB to implement web.py session storage
5.MongoDB Client and Tool set
MongoDB Management Tools
Dex–mongodb Index Optimization Tool
VARIETY:MONGODB Schema Analysis Tool
MongoDB Tool Magicmongodbtool Usage Introduction
MySQL to MongoDB Sync tool
MongoDB's tcpdump tool: Mo
We already know that OSSIM is one of the few open-source SIEM/security management platforms, and there is no integrated log management (LM) system yet.
However, if you want to, you can DIY a log management system and use the latest technologies.
First, you need to use logstash to collect logs. It has a long history, but is very trendy. It supports collecting logs in N ways and outputting logs in N ways. This is a great log collector.
Of course, logstash also supports AMQP. Therefore, if you a
The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion;
products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the
content of the page makes you feel confusing, please write us an email, we will handle the problem
within 5 days after receiving your email.
If you find any instances of plagiarism from the community, please send an email to:
info-contact@alibabacloud.com
and provide relevant evidence. A staff member will contact you within 5 working days.